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An apparatus and a method for monitoring an animal related space 



TECHNICAL FIELD OF THE INVENTION 

The present invention relates to an apparatus for monitoring at least a part of an 
animal related space, comprising a controllable device and at least one image cap- 
turing device for generating and supplying captured image data regarding said ani- 
mal related space. 

It also relates to a method therefore, and furthermore to a remote control device. 
BACKGROUND OF THE INVENTION 

An apparatus and a method of this kind are known from WO 97/15901, which sug- 
gests that a cow is monitored by a video camera. The video camera is connected to 
an image analysing means using colour analysis, by means of which it is possible to 
establish the position of an animal or whether an animal has a bleeding wound. 

In WO 94/19931, a method and a device for surveying animal functions are dis- 
closed. The kind of sensor to be used is not disclosed. However, the sensors are ar- 
ranged i.a. in the milking system, the feeding system and the milking system, indi- 
cating that the kind of sensor to be used is e.g. a milk flow sensor or a feed amount 
sensor. 

The sensors are connected to a plurality of discrete control systems, which in turn 
are connected to a central control system, which is operated by a computer terminal, 
presumably in a control room of the farm. In case of urgency a supervisor is called 
by means of a telephone paging device, and is also informed of the urgency of the 
call. 



Accordingly, the disclosed system is solely a warning system, which means that the 
supervisor, or somebody else, must go to the stall and perform suitable actions. As a 
farmer may be out on the fields when receiving the warning signal, it may take quite 
a while before he or she is able to do so. 

It is thus the object of the invention to provide an improved apparatus and method 
for monitoring an animal related space. 

SUMMARY OF THE INVENTION 

This has been solved by an apparatus of the initially defined kind, which is charac- 
terised in that 

- said image capturing device is associated with a communications port connectible 
to a telecommunications network; 

- a remote control device is associated with a further communications port connecti- 
ble to a telecommunications network; 

- said image capturing device is connectible to said remote control device via said 
telecommunications network; 

- said remote control device is adapted to receive said captured image data; 

- said remote control device is associated with a display unit for allowing viewing of 
said captured image data; 

- a data input means is associated with said remote control device, for entering a 
control instruction, 

- said remote control device is adapted to output said control instruction via said 
further communications port; 

- said controllable device is arranged to be interactively manipulated by said remote 
control device in response to said control instruction. 

It has furthermore been solved by an apparatus of the initially defined kind, which is 
characterised in that said image capturing device is associated with a communica- 
tions port connectible to a telecommunications network, for association of said im- 



age capturing device with a remote control device connecuble to said telecommuni- 
cations network and adapted to receive said captured image data. 



The initially mentioned remote control device is adapted to receive captured image 
data comprising 

- a display unit for allowing viewing of said captured image data; 

- a data input means for entering a control instruction, 

- a corrmaunicatioris port, via which said control instruction is to be output, for inter- 
actively manipulating a controllable device of the apparatus 

The object has also been achieved by a method of the initially defined kind, which 
is characterised by 

. connecting said image capturing device to a communications port for allowing 
connection to a telecommunications network; 

_ connecting a remote control device to a further communications port for allowing 
connection to a telecommunications network; 

- adapting said remote control device to receive said captured image data; 

- providing said remote control device with a display unit; 

- entering a control instruction in a data input means associated with said remote 
control device; 

- transrrutting said control instruction via said further communications port; and 

- interactively manipulating said controllable device by said remote control device 
in response to said control instruction. 

By the defined apparatuses and method, it is possible to remotely view the stall. 

Suitably, said controllable device is associated with said communications port. 
Hereby, it is possible not only to view, but also to interactively perform suitable ac- 
tions in the barn - e.g. via the Internet. 



Preferably, a control means is provided between said controllable device and said 
communications port, said controllable device being automatically controlled by 
said control means. Hereby, it is possible to allow said control means to perform 
operations while remotely viewing said animal related space. 

Suitably, said control means is provided between said image capturing device and 
said communications port, said image capturing device being automatically con- 
trollable by said control means, hereby, it is possible to remotely view the animal 
related space, while allowing said control means to control e.g. the sharpness of the 
image. 

Preferably, a switch means is provided for allowing by-pass of said control means. 
Alternatively, said control means is switchable to a remote control mode for re- 
ceiving said control instruction from said remote control device, said controllable 
device being adapted to perform an operation in response to said remote control de- 
vice via said control means. Hereby, it is possible to choose between a local manual 
or automatic control and a remote manual or automatic control of the image captur- 
ing device and/or the controllable device. 

Preferably, either of said remote control device and said control means is adapted to 
generate an alerting signal if an abnormal situation is established. Hereby, it is pos- 
sible to give a warning to a person handling the remote control, or to the farmer. 

Suitably, said animal related space comprises an animal space, such as an animal 
gateway, provided with said controllable device. Hereby, it is possible to monitor a 
limited area. 

Preferably, said controllable device comprises an openable and closeable gate, a po- 
sition of said gate is established by said image capturing device. Alternatively, said 
controllable device comprises a movable robot arm provided with a gripper. Hereby, 



it is possible to perform animal related operations, such as allowing an animal to or 
prevent it from entering said animal space or cleaning its teats. 

Suitably said image capturing device is arranged on said robot arm. Hereby, it is 
possible, while moving the robot arm, not only to view an object, but also to move 
the image capturing device closer to the object. 

Preferably, a position of a teat of an animal is established by said image capturing 
device, for allowing attachment of a teatcup on said teat. 

Suitably, the apparatus further comprises a milking equipment provided with at least 
one teatcup associated with a pulsator, adapted to be controlled by said remote con- 
trol device. Furthermore, said teatcup is associated with a vacuum source via a 
valve, said valve being adapted to be operated in response to said remote control 
device. Hereby, it is not only possible to remotely perform milking of an animal, but 
also to remotely control the milking operation. 

Preferably, said controllable device comprises a driving means with a turnable axle 
connectible to said image capturing device. Hereby, it is possible to remotely turn 
the image capturing device in a desired direction. 

Suitably, said controUable device comprises a driving means for a zoom lens ar- 
ranged on said image capturing device. Hereby, it is possible to remotely get a 
closer view of an object without moving the image capturing device. 

Preferably, analysis of an image captured by said image capture device is performed 
by said control means. Hereby, it is possible to enter a control instruction outgoing 
from information received from the control means. Alternatively, analysis of an im- 
age captured by said image capture device is performed by said remote control de- 
vice. Hereby, it is possible to automatically manipulate said controllable device by 
means of said remote control. 
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Suitably, said remote control device is provided with a display unit for allowing 
viewing of said captured image data. Furthermore, a data input means is associated 
with said remote control device, for entering a control instruction. Additionally, said 
5 control means is provided with a display unit for allowing viewing of said captured 
image data. A data input means is associated with said control unit, for entering a 
control instruction. Hereby, it is possible to manually manipulate said controllable 
device. 

10 DRAWING SUMMARY 

i 

The invention will now be described in more detail with reference to the accompa- 
nying drawings, in which 

15 Figure 1 illustrates schematically the apparatus according to the invention, 
Figure 2 illustrates schematically a second embodiment of the invention, 
Figure 3 illustrates schematically a third embodiment of the invention, and 

20 

^ Figure 4 illustrates an animal related space. 

DETAILED DESCRIPTION 

. ! 25 Figure 1 shows an animal related robot 2 provided with a robot arm 4 and a gripper 
6 intended to grip an animal related means, such as a teatcup 8 and perform an ani- 

[ \ : ; mal related operation, such as attaching the teatcup 8 onto a teat of an animal. The 
; f " teatcups 8 are connected via a valve 9 to a vacuum source 10 and to a pulsator 12 
for creating a milking vacuum and a pulsating vacuum. 

; '30 



Of course, the robot arm 4 with gripper 6 may also be used for moving other animal 
related devices to said animal, such as a pre-milking unit, a massage unit or a teat 
cleaner, for performing an appropriate animal related operation. 

A robot image capturing device 14, such as a digital camera or a video camera, is 
arranged on the robot arm 4 for viewing e.g. an animal's udder from a relatively 
short distance. A further image capturing device 15, such as a digital camera or a 
video camera, is arranged to view a space in which a robot arm is expected to be 
moved from a distance of the milking robot, which is larger than that of the image 
capturing device arranged on the robot arm 4. 

The image capturing devices 15 are suspended on a pivot connected to a motor 15a, 
which allows the image capturing devices to change the desired view angle. Each 
image capturing devices 15 is furthermore provided with a zoom lens 15b, which is 
adjustable by means of a motor 15c for changing the focal length of the lens. 

The robot 2 and the image capturing devices 15 are connected to a control unit 16, 
provided with a display unit 16a. such as a screen, and a data input means 16b, such 
as a keyboard or a mouse. 

The control unit 16 is furthermore provided with a control program 17 which locally 
controls the movements of the robot arm 4 and the motors 15a. 15c, either automati- 
cally, i.e. in response to at least the image capturing device 14 arranged on the robot 
arm 4 or manually, i.e. in response to the data input means 16b. In case of automatic 
control, the control means 16 performs image analysis of captured images from the 
image capturing devices 14, 15. 

Also the valve 9 and the pulsator 12 are connected to the control means 16 for al- 
lowing local automatic or manual control thereof . 
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An animal related space 18, in the form of an animal gateway is provided with a 
gate 20 having an opening/closing means 22, such as a pneumatic cylinder, which is 
connected to the control unit 16, provided with a control program 23. A further im- 
age capturing device 15 is connected to the control unit 16, which automatically 
5 opens and closes the gate 20 and controls the motors 1 5a, 1 5c, in response to the 
image capturing device 15 connected to this control unit 16. Alternatively, the 
opening/closing means 22 and the motors 15a, 15c are manually controlled by ma- 
nipulation of the data input means 16b. 

10 The animal related space 18 may be a stall for a whole herd of animals or an animal 
> stall for one animal only. In particular, the robot 2 may perform animal related op- 

erations on an animal in an animal related space 18. It should be noted that the ani- 
mal gateway with closed gate 20 is a land of an animal stall. If needed, it is possible 
to add an extra gate 20, so that there is a gate in front of the animal and one gate be- 
15 hind the animal. In the case such an animal gateway with one or two gates 20 is 

provided with a robot 2, the animal gateway may be used for performing animal re- 
lated operations, such as milking. 

The control unit 16 is connected to a communications port 24, such as a modem, 
20 which in turn is connectible to a telecommunications network 26, comprising one or 
| more fixed networks (including radio link) or one or more cellular networks, or a 

combination thereof. 

A remote control device 28 is provided at another point of the telecommunications 
;.! .25 network 26, and is connectible thereto by means of a communications port 30, such 
[ ■[■[ as a modem. The remote control device 28 is provided with a display unit 32, such 
: ' ] ' . as a screen, and a data input means 34, such as a keyboard or a mouse. 

The remote control device 28 furthermore comprises a data processing unit, a vola- 
' •30 tile memory (RAM), and a non-volatile memory (ROM), which contains a 



program for reception of said captured image data. The program is adapted to be 
executed by said data processing unit, in response to received image data from the 
image capturing devices 14, 15. 

5 However, the data processing unit may instead be part of the telecommunications 
network. 

According to this first embodiment, it is thus possible to locally control the robot 
arm 4, the cameras 14, 15 and the gate 20, either automatically (by means of the 
10 program 17) or manually (by means of the data input means 16b). 

In the embodiment of figure 2, the image capturing devices 15 are connected to the 
communications port 24 without previous connection to the control unit 16. 

15 In this case, the image capturing devices 15 will be controlled by the remote control 
device 28, either automatically by a control program, or manually, by manipulation 
of the data input means 34. 

In the embodiment according to figure 3, not only the image capturing devices 15 
20 are arranged to by-pass the control unit 16, but also the image capturing device 14, 
^ the robot 2, the gate closing/opening cylinder 22, the valve 9 and the pulsator 12. A 

switch 36 is provided for each item that should be allowed to by-pass the control 

unit 16. Of course, the switches 36 may be an integrated part of the control unit 16, 

either as hardware or software. 
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The switches 36 individually and selectively are controllable by manipulation of the 

data input means 16 b or 34. If the remote control device 28 is intended to control 
[ e.g. the robot arm 4 the control unit 16 is by-passed by switching the relevant switch 

36 to a by-passing position. In this case, the robot arm 4 will either be automatically 
30 controlled by a program in the remote control device 28, or by manipulation of the 

data input means 34. 
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In the embodiments of figures 1 to 3, there is a common control unit 16 for the robot 
2 and the gate 20. Of course, they may be separate and are then both connected to 
the communications port 24. 

Figure 4 illustrates an animal related space 18, such as an animal shed, provided 
with a robot 2 with image capturing device 14, a plurality of gates 20 and a plurality 
of image capturing devices 14 and 15 and a robot 2. The animal related space is di- 
vided into smaller animal related spaces 18, such as a robot stall, a lane or a residing 
area. 

The control is performed according to anyone of the above described embodiments. 

If the image of anyone of the image capturing devices 14, 15, establishes that an ab- 
normal situation has arisen, e.g. that one or several animals are in a state of panic, 
the gates 20 are controlled to be kept open. If the animal in panic is in the robot 
stall, the milking operation is interrupted; if the milking operation has already 
started, e.g. by closing the valve 9, stopping the pulsator 12 and detaching the teat- 
cups 8. Afterwards, the gates 20 of the robot stall are opened. 



OPERATION 

A stall provided with the apparatus according to the invention works autonomously, 
i.e. the control unit 16 operates automatically or manually without interference of 
the remote control means 28. 

Alternatively, the apparatus is operated by a program run by the remote control 
means 28, either automatically or manually. 
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Alternatively, the apparatus is run by the control unit 16, but if needed, the control 
unit 16 is by-passed and it is then possible to operate the apparatus by the remote 
control means 28, either automatically or manually. 

Accordingly, the captured image data is transmitted to the remote control device 28 
either as image data or via the control unit 16 as analysed image data. 

In order to supervise the stall when the farmer of the stall is on holiday, is asleep or 
is out on the fields, a service firm - which may be situated close to where the stall is 
placed, or at a location very far away therefrom - or another farmer may be con- 
tracted to keep an eye on the stall. This is done via the remote control device 28. 
The firm service may take care of several stalls and supervise them simultaneously. 

If an abnormal situation occurs, such as an emergency situation, the control unit 16 
generates a warning signal, which is transmitted to the remote control device 28. 
The supervisor in charge is accordingly directly warned and is able to view one or 
several images that are transferred. 

Examples of abnormal situations are that an animal lies where not allowed, a tool 
box is left unattended, the robot arm is not able to attach the teatcups onto the teats, 
or the animal has run into a state of panic. 

If the remotely situated supervisor can immediately establish the occurred problem, 
he or she can use the data input means 34 to e.g. move the robot arm, in case it has 
dropped a teatcup on the floor. 

If the supervisor cannot immediately establish the occurred problem, it is possible to 
pivot the image capturing devices 15 to view the whole stall, to switch between 
cameras arranged at strategic places, and when having established where the actual 
problem is, to control the motor 15c to change the focal length of the zoom lens, in 
order to get a closer view of a desired area or space. 
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It should be noted that it is also possible to transfer to said remote control device, 
collected animal related data - such as average milk yield, latest milk yield, feed 
consumption, oestrous etc. - to be used as basis for the generation of a control in- 

struction. 

It should be understood that details of the first embodiment are applicable to the 
second and third embodiments and vice versa. 



am- 



10 It should also be understood that wherever the apparatus makes reference to an 

mal, all kinds of lactating animals are included, such as cows, sheep, goats, buffa- 
loes and horses. 
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CLAIMS 

1. An apparatus for monitoring at least a part of an animal related space, compris- 
ing a controllable device (2, 22) and at least one image capturing device (14, 15) for 
5 generating and supplying captured image data regarding said animal related space, 
characterised in that 

- said image capturing device ( 14, 15) is associated with a communications port (24) 
connectible to a telecommunications network (26); 

- a remote control device (28) is associated with a further communications port (30) 
10 connectible to said telecommunications network (26); 

- said image capturing device (14, 15) is connectible to said remote control device 
(28) via said telecommunications network (26); 

- said remote control device (28) is adapted to receive said captured image data; 

- said remote control device (28) is associated with a display unit (32) for allowing 
15 viewing of said captured image data; 

- a data input means (34) is associated with said remote control device (28), for en- 

tering a control instruction, 

- said remote control device (28) is adapted to output said control instruction via 
said further communications port (30); 

- said controllable device (2, 22) is arranged to be interactively manipulated by said 
remote control device (28) in response to said control instruction. 

2. An apparatus for monitoring at least a part of an animal related space, compris- 
ing a controllable device (2, 22), and at least one image capturing device (14, 15) 
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for generating and supplying captured image data regarding said animal related 



space, 

characterised in that 

- said image capturing device (14, 15) is associated with a communications port (24) 
! connectible to a telecommunications network (26), for association of said image 

-30 capturing device (14, 15) with a remote control device (28) connectible to said tele- 
communications network and adapted to receive said captured image data. 
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3. An apparatus according to claim 1 or 2, wherein said controllable device (2, 22) 
is associated with said communications port (24). 

5 4. An apparatus according to anyone of claims 1 to 3, wherein a control means (16) 
is prodded between said controllable device (2, 22) and said communications port 
(24), said controllable device (2, 22) being automatically controlled by said control 
means (16). 

10 5. An apparatus according to claim 4, wherein said control means ( 16) is provided 
between said image capturing device (14, 15) and said communications port (24), 
said image capturing device being automatically controllable by said control means. 

6. An apparatus according to claim 4 or 5, wherein a switch means (36) is provided 
15 for allowing by-pass of said control means (16). 

7. An apparatus according to claim 4 or 5, wherein said control means (16) is 
switchable to a remote control mode for receiving said control instruction from said 
remote control device, said controllable device being adapted to perform an opera- 

20 tion in response to said remote control device via said control means. 

^ 8. An apparatus according to anyone of claims 4 to 8, wherein either of said remote 

control device (28) and said control means (16) is adapted to generate an alerting 
j signal if an abnormal situation is established. 
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9. An apparatus according to anyone of the preceding claims, wherein said animal 
related space (18) comprises an animal space provided with said controllable device 
(2, 22). 
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10. An apparatus according to anyone of the preceding claims, wherein said animal 
related space (18) comprises an animal gateway provided with said controllable de- 
vice (2, 22). 

5 1 1 . An apparatus according to anyone of the preceding claims, wherein said con- 
trollable device (2, 22) comprises an openable and closeable gate, a position of said 
gate is established by said image capturing device (15). 

12. An apparatus according to anyone of the preceding claims, wherein said con- 
10 trollable device comprises a movable robot arm (4) provided with a gripper (6). 

) 

13. An apparatus according to claim 12, wherein said image capturing device (14) is 
arranged on said robot arm (4). 

15 14. An apparatus according to claims 13, wherein a position of a teat of an animal is 
established by said image capturing device (14), for allowing attachment of a teat- 
cup on said teat. 

15. An apparatus according to anyone of the preceding claims, wherein it further 
20 comprises a milking equipment provided with at least one teatcup (8) associated 

^ with a pulsator (12), adapted to be controlled by said remote control device (28). 

16. An apparatus according to claim 14 or 15, wherein said teatcup is associated 
with a vacuum source (10) via a valve (9), said valve being adapted to be operated 

:25 in response to said remote control device (28). 

17. An apparatus according to anyone of the preceding claims, wherein said con- 
trollable device comprises a driving means (15a) with a turnable axle connectible to 
said image capturing device (15). 
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18. An apparatus according to anyone of the preceding claims, wherein said con- 
trollable device comprises a driving means (15c) for a zoom lens (15b) arranged on 
said image capturing device (15). 

5 19. An apparatus according to anyone of the preceding claims, wherein analysis of 
an image captured by said image capture device is performed by said control means 
(16, 17, 23). 

20. An apparatus according to anyone of the preceding claims, wherein analysis of 
10 an image captured by said image capture device is performed by said remote control 
* device (28). 

21. An apparatus according to anyone of the preceding claims, wherein said remote 
control device (28) is provided with a display unit (32) for allowing viewing of said 

1 5 captured image data, and wherein a data input means (34) is associated with said 
remote control device (28), for entering a control instruction. 

22. An apparatus according to anyone of the preceding claims, wherein said control 
means (16) is provided with a display unit for allowing viewing of said captured im- 

20 age data, and wherein a data input means is associated with said control unit (16), 
| for entering a control instruction. 

23. A remote control device (28) adapted to receive captured image data compris- 
ing a communications port (30), via which said control instruction is to be output, 

'25 for interactively manipulating a controllable device (2, 22) of the apparatus accord- 
ing to anyone of the claims 2 to 22. 
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24. A method of monitoring at least a part of an animal related space, comprising a 
controllable device (2, 22) and at least one image capturing device (14, 15) for gen- 
erating and supplying captured image data regarding said animal related space, 
characterised by 

- connecting said image capturing device (14, 15) to a communications port (24) for 
allowing connection to a telecommunications network (26); 

- connecting a remote control device (28) to a further communications port (30) for 
allowing connection to said telecommunications network (26); 

- adapting said remote control device (28) to receive said captured image data; 

- providing said remote control device (28) with a display unit (32); 

- entering a control instruction in a data input means (34) associated with said re- 
mote control device (28); 

- transmitting said control instruction via said further communications port (30); and 

- interactively manipulating said controllable device (2, 22) by said remote control 
device (28) in response to said control instruction. 

25. A method according to claim 24, including associating said controllable device 
(2, 22) with said communications port (24). 

26. A method according to claim 24 or 25, including automatically controlling said 
controllable device (2, 22) by means of a control means (16) provided between said 
controllable device (2, 22) and said communications port (24). 

27. A method according to claim 26, including automatically controlling said image 
capturing device (14, 15) by means of said control means (16), provided between 
said image capturing device and said communications port (24). 

28. A method according to claim 26 or 27, including by-passing said control means 
(16) by means of a switch means (36). 
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29. A method according to claim 26 or 27, including 

- switching said control means (16) to a remote control mode, 

- allowing said control means (16) to receive said control instruction from said re- 

mote control device (28), 

performing an operation in response to said remote control device (28) via said 
control means (16). 

30. A method according to anyone of claims 26 to 29, including generating an 
alerting signal if either of said control means (16) and said remote control device 
(28) establishes an abnormal situation. 

3 1. A method according to anyone of claims 26 to 30, including performing image 
analysis by means of said control means (16) of an image captured by said image 

capture device (14, 15). 

32. A method according to anyone of claims 26 to 3 1, including viewing said cap- 
tured image data in a display unit (16a) associated with said control means (16), and 
entering a control instruction in a data input means (16b) associated with said con- 
trol means (16). 

33 A method according to anyone of claims 26 to 32, including performing image 
analysis by means of said remote control device (28) of an image captured by said 

image capture device (14, 15). 

34. A method according to anyone of claims 26 to 33, including viewing said cap- 
tured image data in a display unit (32) associated with said remote control device 
(28), and entering a control instruction in a data input means (32) associated with 

said remote control device (28). 
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ABSTRACT 



An apparatus for monitoring at least a part of an animal related space (18) com- 
prises a controllable device (2, 22) and at least one image capturing device (14, 15) 
for generating and supplying captured image data regarding said animal related 

space. 

According to the invention, the image capturing device (14, 15) is associated with a 
communications port (24) connectible to a telecommunications network (26), a re- 
mote control device (28) is associated with a further communications port (30) con- 
nectible to said telecommunications network (26). The image capturing device (14, 
15) is connectible to said remote control device (28) via said telecommunications 
network (26) and the remote control device (28) is adapted to receive said captured 
image data. The remote control device (28) is provided with a display unit (32) for 
allowing viewing of said captured image data. A data input means (34) is associated 
with said remote control device (28), for entering a control instruction. The remote 
control device (28) is adapted to output said control instruction via said further 
communications port (30), and the controllable device (2, 22) is arranged to be in- 
teractively manipulated by said remote control device (28) in response to said con- 
trol instruction. 



(Fig. 1) 




Fig. 4 



